® 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



® Publication number: 



0 282 33% 

A2 



® 



EUROPEAN PATENT APPLICATION 



® Application number: 88302162.8 



Date of filing: 11.03.88 



® int. ci. 4 : H 04 Ft 25/00 



■I 



1 



3 

CO 
CO 
CO 

CM 
CO 
CM 



Q_ 
UJ 



Priority: 13.03.87 US 25524 

Date of publication of application: 
14.09.88 Bulletin 88/37 



© Designated Contracting States: BE DE FR GB 



Applicant: MINNESOTA MINI NO AND MANUFACTURING 
COMPANY 

3M Center, P.O. Box 33427 

St Paul, Minnesota 55133-3427 (US) 

Inventor: Soli, Sigfrid, D.c/o Minnesota Mining and 
Manufacturing Company 2501 Hudson Road 
P.O. Box 33427 St Paul Minnesota 55133 (US) 

van den Honert, Christopher c/o Minnesota Mining & 
Manufacturing Company 2501 Hudson Road 
P.O. Box 33427 St Paui Minnesota 55133 (US) 

Representative : Baillle, lain Cameron et al 
c/o Ladas & Parry Isartorplatz 5 
D-8000 MQnchen 2 (DE) 



16 



Signal processor and an auditory prosthesis utilizing channel dominance. 

v A multichannel signal processor (10) for and an auditory 
prostheses (68) utilizing such a signal processor having a 
plurality of filters (88) each passing a different center frequency 
providing a set of filtered signals representative of the auditory 
content of the electrical input signal relative to its respective 
center frequency. A plurality of gating mechanisms (90) 
individually coupled to the filter signals pass an output signal at 
a level above the perceptual level of the person when the 
filtered signal is above a predetermined level. The predeter- 
mined level is individually determined such that the output is 
past above the perceptual level only when the level of the 
filtered signal to which the gating means is coupled is likely to 
be among the larges of the filtered signals of all of the plurality 
of filters (88). Thus the multichannel signal processor (10) in 
auditory prosthesis (68) can have a combined stimulated signal 
which contains some, but not all, channels, namely those 
channels whose amplitude of signal is likely to rank among the 
highest compared to the amplitude of the remaining channels. 
In a preferred embodiment, such a channel dominant signal 
processor (10) will help preserve periodicities created by 
sharply tuned band pass filters (88). 
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Description 

SIGNAL PROCESSOR FOR AND AN AUDITORY PROSTHESIS UTILIZING CHANNEL DOMINANCE 



Technical Field 

The present invention relates generally to auditory 
prostheses and signal generators for auditory 
prostheses. More particularly, the present invention 
relates to such signal processors employing a 
plurality of band pass filters. 

Background Art 
Various types of multichannel auditory prosthetic 

devices exist in the art. 

One example of a multichannel auditory pros- 
thesis is described in U.S. Patent No. 4,400,590, 
Michelson. Michelson discloses a system that uses 
the theory that differing places along the cochlea 
respond as differing frequencies to the brain. Thus, 
band pass filters break up the incoming auditory 
signal into a plurality of frequency bands. These 
signals are then applied directly to electrode 
locations along the cochlea. In theory, those loca- 
tions which correspond to its associated frequency 
band. 

Another example of a multichannel auditory 
prosthetic device, is described in U.S. Patent 
No. 4,289,935, Zoilner et al and U.S. Patent 
No. 4,403,1 18, Zoilner et al. The system described in 
the Zoilner et al patents uses a set of band pass 
filters to generate frequency bands to turn on and 
off, or to modulate, oscillators (tone generators) 
whose outputs are then summed and transmitted to 
a hearing aid. 

Both of the Michelson and Zoilner et al multichan- 
nel auditory prosthetic devices, however, have been 
less than completely successful in obtaining open 
set speech comprehension without the use of visual 
aids. 

Young and Sachs, in a 1979 article, "Representa- 
tion of Steady-State Vowels in the Temporal Aspects 
of the Discharge Patterns of Auditory Nerve Fibers", 
66 Journal of the Acoustic Society of America , pp 
1381-1403, noted that spectral information is rep- 
resented in the timing patterns of auditory nerve 
discharges. They determined the energy at a given 
frequency by examining temporal responses only 
among neurons whose center frequencies were 
close to that frequency. 

Disclosure of Invention 

The present invention provides a signal processor 
for an electrical input signal intended to represent 
sound to a person and adapted to be utilized in 
conjunction with an auditory prosthesis. A plurality 
of filters, each passing a different center frequency, 
each provide a filtered signal representative of the 
auditory content of the electrical input signal relative 
to its respective center frequency. A plurality of 
gating mechanisms, preferably operating as nonli- 
nearities, are individually coupled to the filtered 
signals. Each of the gating mechanisms passes an 
output signal at a level above the perceptual level of 
the person when the filtered signal is above a 
predetermined level. The predetermined level is 



individually determined such that the output is 
passed above the perceptual level only when the 
5 level of the filtered signal to which the gating 
mechanism is coupled is likely to be among the 
largest of the filtered signals from all of the plurality 
filters. 

In multichannel signal processing devices, an 
10 electrical input signal may provide outputs from a 
plurality of individual filters which are quite complex 
in nature. This is particularly true where the plurality 
of filters are sharply tuned filters, or resonators 
creating output signals which contain periodicities 
15 representative of the energy content of the input 
signal although the present invention is applicable to 
other filter sets as well. In such situations, the 
periodicities combined either in a summer or 
combined in the cochlea when multiply stimulated 
20 may produce undesirable channel interactions. A 
single processor having a gating mechanism con- 
structed as described above can reduce undesirable 
interactions between periodicities from individual 
filters, channels interactions, which can degrade the 
25 spectral to temperal properties of the resonating 
filters and can reduce the likelihood of the produc- 
tion of unpredictably loud sensations to the patient. 

For example, if a nine or ten channel signal 
processor, or auditory prosthesis, is provided it may 
30 be desirable to convey information to the patient 
from only a subset of those channels at any one 
given instant of time. For example, it may desirable 
that only five of the nine or ten channels will be active 
in conveying information above the patient's percep- 
35 tual level at one given instant of time. Threshold 
levels are set in the nonlinearities such that only 
channels whose probable rank in dominance among 
the other channels is among the largest in amplitude 
as compared to the electrical outputs of the other 
40 corresponding channels. 

Previous methods for reducing the number of 
simultaneously active channels involve ongoing 
comparisions of the amplitudes in each channel 
followed by the selection of the highest amplitude 
45 channels. The real-time computations required to 
compare and rank ail channels and then select the 
dominant channels are time consuming and are not 
reasonably feasible for many real-time multichannel 
processing applications especially if a large number 
50 of channels are used. The present invention provides 
an alternative, statistically based approach to the 
selection of dominant channels that is feasible for 
real-time multichannel processing applications. 
Representative channel rank and amplitude statis- 
55 tics can be developed from laboratory analysis of 
speech processed through a computer simulation of 
a multichannel processor. From these statistics, 
threshold parameters for each channel can be 
identified such that each channel exceeds its 
60 threshold value only when it is likely to be one of the 
highest ranking (i.e. dominant) channels. Dominant 
channels are defined probablistically rather than 
exactly by this mechanism. However, the relation- 
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ship between a channel's dominance and Its percep- 
tual importance in speech is also probablistic. 
Channel threshold parameters can be implemented 
in a look up table in a real-time processor obviating 
the need for ongoing real-time corrrparision compu- 
tations between channels to select dominant chan- 
nels. 

Brief Description of Drawings 

The foregoing advantages operation and con- 
struction of the present invention will become more 
readily apparent from the following figures in which: 
Figure 1 is a simplified block diagram of the 
signal processor of the present invention; 

Figure 2 is a representation of the frequency 
spectrum of the vowel "eh" ; 

Figure 3 illustrates a transfer function of the 
band pass filters; 

Figure 4 illustrates the time domain band 
pass filter outputs with a stimulus as defined in 
Figure 2; 

Figure 5 illustrates the amplitude characteris- 
tics of a preferred band pass filter; 

Figure 6 illustrates the phase characteristic of 
a preferred band pass filter; 

Figure 7 illustrates the actual Q's of neurons 
for various frequencies plotted as a function of 
center frequency; 

Figure 8 is block diagram of a preferred 
embodiment of the auditory prosthesis of the 
present invention; 

Figure 9 is an exemplary input/output func- 
tion of a nonlinearity; 

Figure 10 is a fiow chart illustrating how the 
nonlinearity of Figure 9 is defined ; 

Figure 1 1 is a plot of relative dominance of 
one channel as a function of frequency; 

Figure 12 is a plot of relative dominance of 
another channel as a function of frequency; and 

Figure 13 is a block diagram of an alternative 
embodiment of the present invention. 

Detailed Description 

Work by Young and Sachs has demonstrated that 
spectral information is well represented in the timing 
patterns of auditory nerve discharges. In their 
analysis, they determined the energy at a given 
frequency by examining temporal responses only 
among neurons whose center frequencies were 
close to that frequency. 

The auditory central nervous system may perform 
a similar analysis, ignoring inappropriate perio- 
dicities, in responding only to appropriate ones, i;e., 
those close to the inverse of the center frequency 
for each individual nerve fiber. This ability to ignore 
an inappropriate periodicity on a nerve fiber can 
effectively explain the very good speech recognition 
achievable with single electrode cochlear implants. 
Periodic events corresponding to both the fun- 
damental and the formant frequencies may exist in a 
single electrode stimulus waveform. With appropri- 
ate equalization, each of these periodicities will 
appear in the temporal discharge patterns of 
neurons across the entire cochlea. However, they 
will be ignored by the central nervous system except 



when they occur at the corresponding appropriate 
sites along the cochlea. For example, a complex 
stimulus signal containing both 500 Hertz and 200 
Hertz components includes some events In the trrrre 

5 domain which occur at 2 millisecond intervals and 
some which occur at 5 millisecond intervals. Such a 
stimulus signal delivered electrically to the cochlea 
would elicit neuronal impulses at both 2 millisecond 
and 5 millisecond intervals. These im pulses would be 

to elicted everywhere along the cochlea but the two 
millisecond intervals would be ignored except from 
the 500 Hertz neurons. Similarly, the 5 millisecond 
intervals would be ignored except from the 200 Hertz 
neurons. This illustrates that a single stimulating 

15 electrode, stimulating many neurons, can neverthe- 
less deliver information about more than one 
frequency. 

However, it is recognized that the number of 
different periodicities which may be contained on a 

20 single electrode may be limited. For exampte, if a 
single electrode attempts to convey a large number 
of differing periodicities, the combination may create 
additional periodicities not present in the original 
signal which could confuse the auditory centra} 

25 nervous system. For example, if 50 different perio- 
dicites were occuring on a particular neuron, the 
appropriate ones, e.g., 0.5 millisecond for a two 
kfloHertz fiber, might occur too rarely to be detected 
by the nerve fiber. This limitation can be overcome 

30 by the use of multiple electrodes each of which 
stimulates a spatially distinct group of neurons. It 
would then be unnecessary for one electrode, or 
electrode pair, to deliver all of the periodicities 
contained in the incoming signai. Rather, each 

35 electrode or electrode pair, would deliver only 
intervals corresponding to the center frequencies of 
the fibers within its locus or spatial rarrge of 
excitation. This system has the potential to increase 
dramatically the frequency resolution afforded by 

40 multiple electrode auditory prosthetic devices which 
depend on spatial selectivity for achieving frequency 
differentiation. 

A simplified block diagram of a signal processor to 
achieve the appropriate periodicities discussed 

45 above is illustrated in Figure 1. The signal processor 
10 receives an electrical input signal 12. The 
electrical input signai 12 is supplied to a plurality of 
sharply tuned band pass filters 14, 18 and 18. These 
band pass filters 14, 16 and 18 are less than critically 

50 damped and provide an electrical output signal 20, 
22 and 24. These band pass filters have an impulse 
response which is oscillatory. In a preferred im- 
plementation, each of the band pass filters 14, 16, 
and 18 has a Q(3 dB) of more than 0.5. The sharply 

55 tuned band pass filters 14, 16 and 18 operate as 
resonators so that the output signals 20, 22 and 24, 
respectively, contain periodicities corresponding to 
the energy in the electrical input signal 12 corre- 
sponding to the center frequency to which band 

60 pass filters 14, 16 and 18 are tuned. Output signals 
20, 22 and 24 are routed through nonlinearittes 26, 28 
and 30, respectively. Nonlinearities 26, 28 and 30 
may operate to compress output signals 20, 22 aftd 
24 so that the dynamic range of the signal present 

65 may be fitted into the dynamic range remaining in the 
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person to be stimulated. Nonlinearities 26, 28 and 30 
also perform an important gating or threshold, 
function to be described later, in one embodiment, 
the outputs of nonlinearities 26, 28 and 30 are then 
summed in summer 32 and a single output signal 34 
is provided which contains the periodicites present 
in electrical input signal 12. Output signal 34 may 
then be provided to the remainder of an auditory 
prosthesis to be delivered to an electrode to 
electrically stimulate the person or may be provided 
to an electrical to auditory transducer in order to 
acoustically stimulate a person. While the block 
diagram of the signal processor in Figure 1 illus- 
trates three separate band pass filters, resonators, 
14, 16 and 18 it is to be recognized and understood 
that more resonators or fewer resonators may be 
desirable in a particular signal processor and that 
three are illustrated for illustrative purposes only. 

Since too many periodicites present in output 
signal 34 may confuse the individual neurons of the 
auditory central nervous system, only those output 
signals 20, 22 and 24 which are largest in amplitude 
should be applied to the auditory central nervous 
system and, hence, be contained in output signal 34. 
In a preferred embodiment of the signal processor of 
Figure 1, each band pass filter, resonator, 14, 16 and 
18 is a very narrow filter whose purpose is to 
generate an output signal 20, 22 and 24 which is 
periodic if the electrical input signal 12 has signifi- 
cant energy near its center frequency. The period of 
that signal is the inverse of the frequency being 
passed through the resonator 14, 16 and 18. The 
nonlinearity 26 has a "compressive region" which 
serves to compress the resonator output into a 
dynamic range appropriate for the cochlear implant 
and, importantly, a "deadband" to mask out low level 
signals. Signals appear at the outputs of only those 
nonlinearities 26, 28 and 30 whose input signals 20, 
22 and 24 exceed the deadband threshold. The 
nonlinearities 26, 28 and 30 do not alter the 
periodicities contained in those signals. The nonli- 
nearities 26, 28 and 30 determine whether they are 
large enough to be passed on and to limit them from 
becoming too large, i.e. compression. As the signals 
from nonlinearities 26, 28 and 30 are summed in 
summer 32, a composite output signal 34 is 
provided. Note that only some of the signals 20, 22 
and 24 are usually actually present in output signal 
34 because only those signals 20, 22 and 24 which 
have sufficient amplitude to exceed the deadband of 
nonlinearities 26, 28 and 30 actually appear at 
summer 32. Thus, output signal 34 may have more 
than one periodicity but not so many periodicities 
that the periodicities are lost. 

Figure 2 shows the frequency spectrum of a vowel 
"eh" 36, before appropriate high frequency em- 
phasis 38 at 30 dB per octave. The spectrum of the 
vowel "eh" 36 shows formant peaks near 0.5 
kiloHertz and 2.0 kiloHertz. The frequency spectrum 
of the vowel illustrated in Figure 2 is then applied to 
each of ten resonators 40 illustrated in Figure 3 
tuned at one-half octave intervals between 0.177 
kiloHertz and 4.0 kiloHertz. The transfer function of 
resonators 40 correspond to resonators 14, 16 and 
1 8 of a signal processor as illustrated in Figure 1 . The 



time domain output signals of these resonators 40 
are illustrated in Figure 4 by reference numerals 
42-60. Notice that the time domain output signals 54 
and 46 are the greatest in amplitude which corre- 

5 sponds to the 0.5 kiloHertz and 2.0 kiloHertz formant 
peaks of the frequency spectrum of Figure 2. Thus, 
resonators 40 have created periodicites, mainly 
signals 54 and 46, which corresponds to the 
frequency of energy contained in the input signal of 

10 the vowel 36. 

The amplitude characteristic 62 of a preferred 
bandpass filter is illustrated in Figure 5. Correspond- 
ingly, the phase characteristic 64 of a preferred band 
pass filter is illustrated in Figure 6. The sharpness of 

15 each, band pass filter is measured by the Q of the 
band pass filter. The Q is determined by dividing the 
center frequency of the filter by the bandwidth of the 
filter as measured by the frequencies which are 
given amount dB down from the peak of the filter 

20 response. Thus, the value of Q must be expressed in 
terms of Q for a particular dB. If the bandwidth of the 
filter response as measured 3 dB down from the 
peak is a given frequency width and that frequency 
width is divided into the center frequency, the Q(3 

25 dB) is obtained. Similarly, a Q(10 dB) can be 
obtained by taking the bandwidth at the 10 dB down 
points on the amplitude curve 62 of Figure 5. Thus, it 
can be seen that the higher the value of Q the more 
sharply tuned the individual filter. Also, it can be 

30 seen that a given filter will have a Q(3 dB) which is of 
a greater numerical value than its corresponding 
Q(10 dB). For purposes of the present invention, it is 
preferred that the filter response be underdamped, 
i.e., the Q(3 dB) be more than 0.5. The filter response 

35 is preferred to have an oscillatory response to a step 
or impulse input. This is referred to its impulse 
function being oscillatory. As illustrated in Figure 6, 
the phase characteristic of the filter is preferred to 
be positive for frequencies below the center fre- 

40 quency of the filter, have a sharp transition through 
zero at the center frequency and be negative for 
frequencies greater than the center frequency of the 
filter. This mimics the phase characteristic of the 
individual neurons of the auditory central nervous 

45 system. 

In a preferred embodiment, the Q of each 
individual filter should match the Q actually 
measured for nerve fibers with similar center 
frequencies. Such Q's have been measured by Kiang 

50 et al "Discharge Patterns of Single Fibers in the 
Cat's Auditory Nerve" , MIT Research Monograph 35, 
Library of Congress 6614345 (1965). The Q's 66, as 
determined by Kiang et al are depicted graphically in 
Figure 7. Here the Q's 66 illustrated are Q(10 dB) 

55 values. 

Figure 8 represents a block diagram of a preferred 
embodiment of a auditory prosthesis 68 of the 
present invention. A microphone 70 transforms a 
given auditory signal into an electrical input signal 

60 12. The electrical input signal 12 is fed to a 
switchable iowcut filter 72 to optionally provide noise 
supression for low frequency noise components. An 
automatic gain control 74, which may have an 
external sensitivity control, limits the dynamic range 

65 of the electrical input signal 12. A pre-emphasis filter 
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76 boosts the high frequency components common 
in speech signals. A gain element, amplifier, 78 
compensates for internal signal losses. An anti-alias- 
ing filter 80 prevents corruption of the signal by 
frequencies above the Nyquist frequency of 5 
kiloHertz. Another gain element, amplifier, 82 again 
compensates for internal losses. A sample and hold 
circuit 84 and analog to digital converter element 86 
convert the signal to a digital representation. 
Elements 70, 72, 74, 76, 78, 80, 82, 84 and 86 are 
conventional and well known in the art. Elements 72, 
74, 76, 78, 80, 82 and 84 are optional and are 
illustrated here as being part of the preferred 
embodiment of the auditory prosthesis 68. A digital 
signal processor 10 corresponds to the signal 
processor 10 illustrated in Figure 1 . Signal processor 
10 contains a plurality, namely nine, band pass filters 
88A - 88 1, each passing a different center frequency. 
In a preferred embodiment, filter 88A has a center 
frequency of 0.5 kiloHertz; filter 88B, 0.5 kiloHertz; 
filter 88C, 0.71 kiloHertz; filter 88D, 0.91 kiloHertz; 
filter 88E, 1.17 kiloHertz; filter 88F, 1.5 kiloHertz; filter 
88G, 1.94 kiloHertz; filter 88H, 2.5 kiloHertz and filter 
88I, 3.2 kiloHertz. The individual outputs of filters 
88A-88I are passed to nonlinearities 90A - 90I. The 
outputs of these nine nonlinearities 90A - 90! are 
then provided to summer 32 where the signals are 
digitally summed together and converted back into 
an analog signal by digital to analog converter 92. An 
inverse filter 94 is provided to compensate for any 
subsequent known transmission characteristics of 
the auditory prosthesis. An internal volume control 
96 is supplied to allow for appropriate amplitude 
adjustment by the person and the signal is then 
provided to an electrode, or electrode pair, 98. 
Elements 92, 94, 96 and 98 are conventional and well 
known. Elements 94 and 96 are optional. In a 
preferred embodiment, microphone 70 is a Knowles 
EA1934 with 3 dB downpoints at 250 Hertz and 8 
kiloHertz. In a preferred embodiment, lowcut filter 72 
is a 6 dB per octave lowcut filter with corner 
frequencies switch selectable by the patient at either 
250 Hertz or 500 Hertz. In a preferred embodiment, 
automatic gain control circuit 74, has an attack time 
of approximately 1 millisecond and a release time of 
approximately 2 seconds. The threshold is deter- 
mined by a sensitivity control. In a preferred 
embodiment, pre-emphasis filter 76 is a 6 dB per 
octave high pass filter with a corner frequency at 4 
kiloHertz. Pre-emphasis filter 76 is intended to 
compensate partially for the 10-12 dB per octave 
high frequency roll off in the long term spectrum of 
speech, thus, decreasing the loss of amplitude 
resolution in high frequency components of speech. 
Gain element 78, anti-aliasing filter 80, gain element 
82, sample and hold element 84, analog to digital 
converter element 86, digital to analog converter 
element 92, inverse filter 94, volume control 96 and 
electrode 98 are conventional elements well known 
in the art. In the preferred embodiment of the 
auditory prosthesis 68, filters 88A - 88! are digitally 
implemented at their indicated center frequencies. In 
a preferred embodiment, filter 88A and filter 88B 
have a Q(10 dB) equal to 3, filters 88C, 88D and 88E 
have a Q(10 dB) equal to 4, filter 88F has a Q(10 dB) 



equal to 5, filter 88G has a Q(10 dB) equal to 6, filter 
88H has a Q{10 dB) equal to 7 and filter 881 has a 
Q(10 dB) equal to 8. The digital implementation of all 
filters are preferred to be fourth order. The digital 
5 implementation of such filters are conventional m 
design and are well known although not used for this 
purpose or function. 

The implementation of nonlinearities 90A - 9CH Is a 
function of input fitting and output fitting. Each 

10 nonlinearity maps a range of instantaneous input 
signal levels as produced by resonators 88A- 88I, 
respectively into a range of instantaneous output 
signal levels. The mapping function has a linear 
region 100, a cascade of two power functions 102 

15 and 104 and a saturation function 106 as shown in 
Figure 9. By mapping the input levels into the 
saturation region 106 or into either of the power 
function regions 102 and 104, any range of input 
levels can be compressed into the desired output 

20 range. The output range is tailored to the subject's 
electrical dynamic range. The input range is also set 
as part of the input fitting to map a desired range of 
filter output levels into the compressive region of the 
output range and thus into the subject's electrical 

25 dynamic range. 

The output range is fitted to the subject with three 
nonlinearity parameters Y(min) 108, Y(mid) 110 and 
Y(max) 112. Y(min) 108 defines the boundary 
between the linear function 100 and the first power 

30 function 102. Y(min) 108 Is set at the subject's 
perceptual threshold, i.e., the level below which the 
subject has no auditory perception. Y(max) 112 
defines the boundary between the second power 
function 104 and the saturation function 106. Thus, 

35 output levels greater than Y(max) 112 are not 
produced. Y(max) 112 for an individual subject is 
determined in conjunction with the uncomfortable 
loudness level of the individual subject. Y(mid) 110 
which corresponds to the boundary between the 

40 first power function 102 and the second power 
functions 104 is defined as the value of Y(min) 108 
plus 0.66 times the quantity Y(max) 112 minus 
Y(min) 108. 

The input dynamic range of each nonlinearity 

45 90A - 90I is fitted to the distribution of the instanta- 
neous signal levels in speech measured at the 
output of the individual filters 88A-88I. Three 
parameters X(min) 114, X(mid) 116 and X(max) 118 
which define corresponding coordinate pairs with 

50 the Y values 108, 110 and 112 are used to fit the 
nonlinearity. Two optional approaches in fitting the X 
values 114, 116 and 118 can be utilized. 

In a first nonpreferred approach, the 95th percen- 
tile of the distribution of the instantaneous output 

55 levels from each filter 88 Is computed for a large 
sample of processed speech. X(max) 118 is set to 
this value. Using this value, 50/o of the filter output for 
an individual channel is mapped into the saturation 
function 106. X(min) 1 14 is then set to a value 20 dB 

60 below X(max) 118 and X(mid) 116 is set halfway 
between X(max) 118 and X(min) 114. These parame- 
ters map approximately 400/0 -50% of the input 
speech levels into the subject dynamic range for 
each channel. With the remaining 500/o - 60% failing 

65 at or below threshold in the linear function 10®, this 
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approach mixes a large number of channels which 
contain suprathreshold components. Thus, the com- 
posite signal from summer 32 may exhibit a large 
number of periodicities. 

In a present invention, a "channel dominance" 
approach is utilized in which only the outputs from 
filters 88A - 88I whose signals are likely to be the 
largest pass or are gated through nonlinearities 
90A - 90! and, thus, are gated onto summer 32 and, 
hence, whose periodicities are present in the output 
signal which are above the patient's perceived 
threshold level. In this way, the number of perio- 
dicities present in the summed signal are reduced 
and appropriate possible periodicity interactions are 
also reduced. This is accomplished by increasing the 
values of the X parameters 1 14, 116 and 118 so that a 
greater percentage of the speech input signals 
would be mapped into the linear function 100 and, 
thus, be below the perceptual level of the patient. 
Utilized in this manner, only the highest amplitude or 
dominant channels are at suprathreshold levels. 

Figures 11 and 12 represent amplitude distribu- 
tions for two exemplary channels in an exemplary 
signal processor. A large sample of recorded 
speech materials were processed by computer 
simulation and the computations compared and 
ranked ail channels contained in the auditory 
prosthesis previously illustrated in Figure 8. Figure 
11 represents channel 4 of the signal processor 10 
of Figure 8 having a center frequency of 500 Hertz. 
The horizontal axis represents the RMS level of this 
channel expressed in decibals relative to a base of 1 . 
The vertical axis represents the proportion of the 
time instances that this channel has the indicated 
rank. Line 301 in Figure 11 represents the ampli- 
tudes of the 500 Hertz channel oniy for those 
instances when it is the highest ranked channel in 
terms of amplitude among all of the channels of the 
signal processor. Similarly, curve 302 represents 
those amplitudes only for those instances when this 
channel is ranked second in amplitude. A corre- 
sponding relationship holds true through curve 310 
in which displays the amplitudes only for those 
instances when the 500 Hertz channel was the 
lowest ranking channel. From the distributions 
exhibited in Figure 11, it can be seen that the 500 
Hertz channel exhibits a contingent relationship 
between rank and amplitude with contingent chan- 
nels like this 500 Hertz channel illustrated in Figure 
11a channel threshold can be defined such that the 
channel will be activated only when it is likely to be 
one of the highest ranking or dominant channels. For 
example, a channel threshold set at 50 decibals 
would include most of the instances when the 
channel was one of the top five channels and would 
exclude most of the instances when the channel was 
one of the bottom five channels. 

In the present example then X(min) 114 is set at 50 
decibals. X(max) 118 is set at a level to include 
almost all of the remaining available signals, in this 
example 70 decibals. X(mid) 116 is set at the 
midpoint between X(min) 114 and X(max) 118, or at 
60 decibals. 

Figure 12 illustrates another exemplary channel, 
this channel being the channel whose center 



frequency is set at 178 Hertz. The graph of Figure 12 
corresponds in representation to that illustrated 
from the graph in Figure 11. Again, curve 311 
represents the amplitudes when this individual 

5 channel is the highest ranking channel, curve 312 
represents the amplitudes when this channel is the 
second ranking, curve 313 when it is the third 
ranking and so on through curve 320. With the 
behavior exhibited by the channel of Figure 12, it can 

10 be seen that the distributions are not contingent, i.e., 
there is little contingent relationship between ampli- 
tude and rank. There is no decibal level at which a 
threshold will be set in which most of the instances 
in which the channel is highest ranked could be 

15 achieved and those at when which it is lower rank 
could be achieved. A noncontingent channel as the 
channel illustrated in Figure 12 may be either entirely 
excluded from the sum, included entirely in the sum 
or, perhaps, included but at a reduced level, thus, 

20 reducing the possibility of confusion due to its 
contained periodicities. 

With the X values 114, 116 and 118 and the Y 
values 108, 110 and 112 determined as specified 
above, a flow chart for a program to digitally 

25 implement the function of the nonlinearities 90 is 
illustrated in Figure 10. Digital program operates by 
starting at block 200 and individually implementing 
sequentially each individual channel A-l. Since each 
individual channel is identical to the other, only one 

30 channel implementation, namely channel A will be 
described. A digital filter is implemented by block 
202 which corresponds to filter 88A. This digital 
implementation is conventional and well known in 
the art. For the first channel, the program in block 

35 204 takes the output from block 202 and implements 
the linear function 100 of Figure 9 by determining if 
the X value is within the range of the linear function 
100. If yes, the program determines the output 
function Y(t) by obtaining constant values A1 and B1 

40 and applying them to the formula A1 x X(t) 4- B1. If 
the value of X(t) is not within the range of the linear 
function 100, then block 206 determines if the X 
values are within the range of the first power function 
102. If yes, then the program determines the Y 

45 output value by looking up values A2 and B2 in a 
table and applying it to the formula Y(t) = A2 x X (t) 
4- B2. Preferably this can be accomplished by a 
plurality of piecewise linear segments to approxi- 
mate a iogrithmic curve. Similarly, the second power 

50 function 104 is implemented in block 208, if 
appropriate by using the table look up for the values 
A3 and B3. Also preferably a iogrithmic curve may be 
approximated with linear segments. Finally, the 
program implements the saturation function 106 by 

55 block 212 if the X value X(t) is within the value of the 
saturation portion by simply outputting a known 
constant since the curve is saturated. The program 
then repeats each of these individual blocks for each 
individual channel contained within the digital signal 

60 processor 10. 

In the preferred embodiment, the program illus- 
trated in Figure 10 is implemented on an integrated 
circuit which forms and operates as signal proces- 
sor 10. This integrated circuit is a model 320C10 

65 integrated circuit manufactured by Texas Instrument 
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Corporation, Dallas, Texas. In the program of Figure 
10, the value obtained from each individual channel 
is then digitally summed at block 214 to obtain the 
final Y(t) and the program is ended at block 216 and, 
hence, repeats. 

An alternative embodiment of the auditory pros- 
thesis 120 is illustrated in Figure 13. The auditory 
prosthesis 120 is similar to the auditory prosthesis 
68 of Figure 8 in that it has a microphone 70 «nd 
automatic gain control circuit 74, a pre-emphasis of 
filter 76 and a signal processor 10. Signal processor 
10 contains a single analog to digital converter 86 
which supplies the electrical input signal to 10 filters 
88A - 88J. The center frequencies at 176 Hertz, 250 
Hertz, 353 Hertz, 500 Hertz, 707 Hertz, 1 kiloHertz, 
1.4 kiloHertz, 2 kiloHertz, 2.8 kiloHertz and 4 
kiloHertz, respectively. Each filter 88 is supplied to a 
noniinearity 90A - 90J individually. Filters 88 and 
noniinearities 90 operate identical to the filters 88 
and noniinearities 90 illustrated in Figure 8. However, 
in the embodiment illustrated in Figure 11 the output 
of the individual noniinearities instead of being 
summed together are individually passed to digital to 
analog converters 92A - 92J. Alternatively one digital 
to analog converter 92 could be time division 
multiplexed and, hence, coupled to all noniinearities 
90A - 90J. The output of each individual digital to 
analog converter 92A - 92J is supplied to an individ- 
ual current source 122A-122J which individually 
supply an electrode 124A - 124J. Thus, each individ- 
ual filter 88A-88J ultimately supply an individual 
electrode 124A - 124J. Thus, an individual electrode, 
e.g., 124A, would contain only the periodicities of 
one filter, namely, resonator 88A. The wires sup- 
plying electrodes 124A - 124J are illustrated passing 
through a percutaneous plug 126. Electrodes 
124A - 124J while illustrated in Figure 11 as a single 
wire will exist in the patient as an electrode pair since 
they must pass current from one individual electrode 
element to a second individual electrode element. 
Thus, electrode 124A may represent a wire element 
pair designed to be positioned within the cochlea. 
Alternatively, electrodes 124A- 124J may represent 
single electrode elements which pass current from 
their individual elements to a single common return 
electrode (not shown). 

While the description of the preferred embodi- 
ment is described as electrically stimulating a 
person as in a cochlear implant, it is to be 
recognized and understood that the present inven- 
tion is also applicable to acoustic stimuiation as in a 
hearing aid. 

While the description of the preferred embodi- 
ment is described as having the predetermined 
characteristics of the noniinearities and/or filters as 
being set for all time, it is to be recognized and 
understood that these predetermined values could 
advantageously be recomputed occasionally, peri- 
odically or upon the occurrence of a certain event 
and still be predetermined in the intervals in 
between. 

Throughout this description, it has been preferred 
that filters 88 be sharply tuned, high Q filters which 
function as resonators. It is to be recognized and 
understood, however, that the present invention will 



also operate advantageously with bandpass filters 
which are not as sharply tuned, which do ho have 
high GTs or which do hot function as resonators. The 
channel dominance selection of noniinearittes^O stfH 

5 operate to simplify the resulting signal to be sujfjpffed 
to the auditory central nervous system. 

Thus, there has been shown and described a 
novel signal processor for an auditory prosthesis 
utilizing channel dominance. It is to be recognized 

TO and understood, however, that various changes, 
modtfications and substitutions in the form and in 
the details of the present invention may be made by 
those skilled in the art without departing from the 
scope of the following claims. 

15 



Claims 

20 1. A signal processor for an electrical input 

signal designed to represent sound to a person 
and adapted to be utilized in conjunction with 
an auditory prosthesis, comprising: 

a plurality of filters, each passing a different 

25 center frequency, each operatively coupled to 

receive said electrical input signal and each 
providing a filtered signal representative of the 
auditory content of said electrical input signal 
relative to Its respective center frequency; 

30 a plurality of gating means, being individually 

coupled to said filtered signals of said plurality 
of filters, for passing an output signal at a level 
above the perceptual level of said person when 
said fHtered signal is above a predetermined 

35 level, said predetermined level being individually 

determined such that said output is passed 
above said perceptual level only when the ievel 
of said filtered signal to which said gating 
means is coupled is likely to be among the 

40 largest of said filtered signals of all of said 

plurality filters, each of said output signals being 
adapted to be utilized in said auditory pros- 
thesis; 

whereby said signal processor passes only 

45 some of all of said filtered signals from said 

plurality of filters at a given instant of time. 

2, An auditory prosthesis adapted to receive 
a sound signal and transform and transmit said 
sound signal to a signal representing sound to a 

50 person, comprising: 

transducer means adapted to receive said 
sound signal for transforming said sound signal 
to an electrical signal; 

a plurality of filters, each passing a different 

55 center frequency, each operatively coupled to 

receive said electrical signal and each providing 
a filtered signal representative of the auditory 
content of said electrical signal relative to its 
respective center frequency; 

60 a plurality of gating means, being indfvkfually 

coupled to said filtered signals of said plurality 
of filters and being operatively coupled to saftJ 
coupling means, for passing an output signal at 
a level above the perceptual level of said person 

65 when said filtered signal Is above a pr&feter- 
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mined level, said predetermined level being 
individually determined such that said output is 
passed above said perceptual level only when 
the level of said filtered signal to which said 
gating means is coupled is likely to be among 
the largest of said filtered signals of all of said 
plurality filters, each of said output signals being 
adapted to be utilized in said auditory pros- 
thesis. 

coupling means operativeiy coupled to said 
plurality of gating means for receiving all of said 
output signals and transmitting said output 
signals in a form which may be adapted to be 
supplied to said person. 

3. An auditory prosthesis for receiving an 
auditory signal representing sound and sup- 
plying an electrical signal which is adapted to 
stimulate the auditory nerve of a person, 
comprising: 

transducer means adapted to receive said 
auditory signal for transforming said auditory 
signal to an electrical input signal: 

generation means operativeiy coupled to 
said electrical input signal for generating a 
plurality of electrical signals selectively replicat- 
ing the normal temporal nerve discharge pat- 
tern of auditory nerve fibers of individual 
locations within a normally functioning cochlea 
of a person; 

a plurality of gating means, being individually 
coupled to said filtered signal of said plurality of 
filters and being operativeiy coupled to said 
stimulation means, for passing an output signal 
at a level above the perceptual level of said 
person when said filtered signal is above a 
predetermined level, said predetermined level 
being individually determined such that said 
output is passed above said perceptual level 
only when the level of said filtered signal to 
which said gating means is coupled is likely to 
be among the largest of said filtered signals of 
all of said plurality filters, each of said output 
signals being adapted to be utilized in said 
auditory prosthesis; 

stimulation means, operativeiy coupled to 
said output signal, for stimulating selected 
auditory nerve sites within the cochlea corre- 
sponding to said individual locations. 

4. A signal processor as in claim 1 or an 
auditory prosthesis as in claims 2 or 3 wherein 
said predetermined level for each of said 
plurality of gating means is based upon the 
contingent distribution of ranks of all of said 
filtered signals. 

5. A signal processor or an auditory pros- 
thesis as in claim 4 wherein said plurality of 
gating means individually utilize said predeter- 
mined levels by means of a table lookup 
mechanism. 

6. A signal processor as in claim 1 or an 
auditory prosthesis as in claims 2 or 3 in which 
each of said gating means further comprises a 
nonlinearity for introducing a noniinearity into 
said filtered signal which is above said percep- 
tual threshold. 



7. A signal processor or an auditory pros- 
thesis as in claim 6 wherein said noniinearity has 
a linear function portion, a compressive nonli- 
near function portion and a saturation function 
5 portion. 
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